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(57) Abstract 

A method for providing remote access to on-line re¬ 
sources comprising the steps of encoding addsaHaad^access 
information and optional source 

vwLtinp the encoded information onto a document (14). scan 
ning tte document with a scanner cnhanc^J^ «noo 
unit (10, 10A), transmitting the scannedl information, reaiv 
ine the transmitted information, optionally procegmg th e re¬ 
ceived information, optionally collecting£ wMb 
and source identification information, retrieving the on-hne 
Strand displaying the o*4ine 
an apparatus which provides remote access to 

SSinTan of addltss “ d .“ ce “ ™ 

optional source identification information. an ^^tn* sys 
tern, a scanner enhanced remote control unit (10, 
prising a scanning system (22), a transmitter (24), a receiver 
(Sa) an optional processor, an optional collector of the user 
SnograplS and sSnoWentification information, a retnev- 
ing system, and a display system (20). 
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technica l field 

This invention relates to the Internet, and in 
particular to a method and system for providing remote 
access to on-line resources. 

flftrrcponND ART 

Electronic data sources, such as the Internet and 
the World Wide Web (WWW) are a rich and important means of 
information retrieval and distribution and, increasingly, 
electronic commerce. However, there are problems finding 
and accessing the information desired in this increasingly 
complex and dynamic network of resources. Recently 
introduced Internet "search engines", such as Yahoo, help by 
allowing a user to search on-line indices of information 
sources, and even full source text, for relevant key words 
and phrases related to their topic of interest, but even 
carefully structured queries by experienced users often 
results in hundreds and even thousands of possible "hits" 
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which are not sufficiently specifin - 

. y P lfic to preclude further 

manual search which is both Ha*- 

H bOCh data resource inefficient 

time consuming. ^cient and 

Because of these inefficiencies, as well as 

general lack of familiarity with search «, ■ 

gvn w. ¥ , 7 search engines and their 

Y 11 x, users sometimes rely on n-ri 

y on printed media to iHonn« 
source addresses (e. g uniform D identify 

web sites and o^ lllTZTT 

Un information of interest 

wever. URL's. are particularly difficult to 
manually enter in software U t0 

- their length and use ol - 

If the characters in an address are not Symb ° 1S ' 

retrieval is prevented or. in a U, lr „ X ' 

legal but incorrect source is acc ! " ^ CaSeS ' 3 

true when URL's incorporate forei^^ ' ^ ° BP * Ci * U V 

^ery instructions to on-line databaseTaTIs 

frequent in most web sites. In ad dit singly 

type or otherwise manually enter ^ to 

nformatron due to either disability or lack of t • • 
complicates use of on-lin. < c training 

internet and World wide Web LTlr" ^ 38 th3 

“ - -ely anticipate; ;ri: 

——... m* —- 

top conversion units in conlulcf reCeiV3rS “* 8eC - 

television receivers «eb- „ “"ventional 

that can receive and d T teleVlSl ° n 3 tala vision 
television — 

-Hewing a user to access the Inter!“tT" ^ *" 

“ d 3PPr ° Pri ately programmed microprocessor 1 ? 9 * 

circuitry. A software module such as a web d 

by the computer means to allow the . 

anew the user to dial-up an 
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internet service provider (ISP) and request files from host 
servers on the Internet. The downloaded Web pages may be 
displayed via the browser on the entire screen or on a 
portion of the TV screen (i.e. via picture-in-picture 
(PIP)) • Thus, the user can both watch TV and surf the 
Web", as independent functions, with one piece of equipment. 

A set-top converter is similar in functionality and is used 
in conjunction with a conventional TV to accomplish the same 
effect; for example, SONY markets such a device as a “WebTV" 
product. In a home entertainment environment, it is 
difficult to use keyboards for address entry due to both a 
lack of typing skill and the cumbersome placement of these 

components. 

Therefore, a method which would eliminate typing 
and allow users to directly link printed media options to 
on-line resources by simply scanning them while watching 

television would be highly desirable. 

Another problem which is prevalent is the lack of 

information available to on-line resource providers 
regarding the users who access their on-line resources and 
the origin of the address and access information used to 
link to their on-line resource. Often a potential user must 
undergo a lengthy and perhaps intrusive, interactive 
question and answer process in order to be authorized for 
access to a particular on-line resource. In today's world 
of limited time and unlimited options it becomes 
increasingly likely that a potential user will either 
hastily enter the first answer which comes to the 
imagination or which appears on the questionnaire or even 
bypass the site entirely. Naturally, neither of these 
responses is particularly accurate nor useful to the on-line 

resource provider. 


30 
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Therefore, a method which would provide 
demographic information regarding the user as well as 
identification information regarding the particular printed 
ocu-t in which the address and access information to 1 i nk 
h °^e ° n - U " e - — would he of great value to 

for lie * reSOUrCS PrOVider ' Th3t iS ' U ^ useful 

scans a bar code svmbol f television show and who 

that h , 0 ” * Printed related to 

hnl £r ° n 3 br ° adCaSt SChed “ le b °°*’ to he made 

own in an automatic fashion to the li„ ked web site for 

future advertising analysis purposes. 

Therefore, there is a need for an efficient 

auto t io Unk ^ Md ^ 

dr:: :::L;:r; y to the ^ ° f ——- 

tisfy both commercial and informational 

enterprises, m particular, there is a need t-o 

the automatic linking n f ,. incorporate 

in the context of the norll reS ° Ur ° eS 

television viewers W1 " 9 ^ * b »* d «« 



The present invention is a combination televi • 

remote control and optical ,i e h „ television 

optical (i.e. bar code) scanner 

coapnsing a housing, optical scanning means within the 

housing for scanning a machine-readable symbol print d 

document and producing an electrical signal™ Z 9 

the machine-readable signal th*» ma u- f 

. . signal, the machine-readable svmbol 

being encoded with data representative of a location of 
networked resource such as a data file to be accessed b ‘ 
networked computer means associated with the apparatus •" ‘ 

ZZZT a T housin9 for proces8in9 the aia =™' 

signal to produce address 

ress information useful in accessing 


WO 98/51036 


PCT/US98/09413 


the data file; means within the housing for transmitting the 
address information to a remotely located computer means; 

and 

means within the housing for remotely controlling a 
television means associated with the computer means. 

In further accordance with the present invention a 

method is provided for remote access to on-line resources 
comprising the steps of encoding address and access 
information, and optional source identification information 
into a format suitable for embedding onto a document, the 
format comprising one or two-dimensional bar codes or 
conventional printed characters, embedding the encoded 
information onto a document, scanning the document with a 
scanner enhanced remote control unit comprisinQ a scanning 
system adapted to obtain an image of the embedded 
information and a transmission system adapted to transmit 
the scanned information to a computer means, transmitting 
the scanned information to the computer means, receiving the 
transmitted information by the computer means, optionally 
processing the received information, optionally collecting 
the user demographic and source identification information, 
]T 6 tri 6 vin 9 the on-line resource correlated to the address 
information, and displaying the on-line resource to a user 

on the television screen. 

In further accordance with the present invention 

an apparatus is provided which comprises remote access to 
on-line resources comprising an encoder of address and 
access information and optional source identification 
information into a format suitable for embedding onto a 
document, an embedding system for rendering the document 
including the encoded information, a scanner enhanced remote 
control unit comprising a scanning system adapted to obtain 
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an image of the embedded infection. a transmitter „ hich 

r n::::r acanned infor ”’ ati ° n to a comp — —a 

“ C19ted WUh the 0OTPUC « —• wl >ich receives 

transmitte d information, an optional processor of the 

received information, an optional collector of the user 
emographic and source identification information, a 
source retrieval system, and a resource display system. 



These and other objects and features of the 

invention shall now be described in relation to the 
drawings. 




-luotidteg scanning 




'"“'-“j-ue readable 


symbol on a print 

print™ uucument by a first embodiment of a 
~ ^ rem ° te C ° ntr01 “ nit ° f the 

tran discrete from the 

transmission system used to tr an «, mi , 

. - . Q to transmit scanned and other 

information to a web-ready television 

unit. television or set-top converse 

r*- ~r;, 

.—trr.rir" .r— 

_ . S system that is integral with 

transmission system used to transmit th 

to transmit scanned infrwm-s*. • 

the web-ready television or set ton nation to 

or se t-top conversion unit 

Pig. 1C illustrates transmission of 
of . . •‘■‘Uisnussion of scanned data 

of the machine readable symbol by either of m, „ 
of Y lcner of the embodiments 

Of the scanner enhanced remote control unit of Pigs 1A o 

» to the web-ready television or set-too c 

set to P conversion unit 

Fig. 2 A illustrates scanning of a printad a 

by a third embodiment of the P * d document 

of the scanner enhanced remote control 
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unit of the present invention using optical character 
recognition. 

Fig. 2B illustrates transmission of scanned data 

of the printed document by the scanner enhanced remote 

control unit of Fig. 2A to a personal computer adapted for 

access to on-line resources. 

Fig. 3 illustrates a block diagram of the third 

embodiment of the scanner enhanced remote control unit of 
Fig. 2A. 

Fig. 4A illustrates a one -dimensional bar code of 
the prior art. 

Fig. 4B illustrates a two-dimensional bar code of 
the prior art. 

Fig. 5 illustrates two sets of stylized fonts of 
the prior art designed to make optical character recognition 

less prone to errors. 

Fig. 6 illustrates a flowchart for a method of 
linking to on-line data resources with a scanner enhanced 

remote control unit. 

Fig. 7 illustrates an alternative embodiment 
flowchart for a method of linking to on-line data resources 

with a scanner enhanced remote control unit. 

Fig. 8 is a detailed block diagram of the system 

of the present invention. 

Fig. 9 is a diagram of the document generation 

function of Figure 8. 

Fig. 10 is a diagram of the user's computer 

functions of Figure 8. 

Fig. 11 is a diagram of the de-obfuscating 

function carried out by the user's computer means of Figure 
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Pig. 12 is a diagram of the target server 
of Figure 8 . server computer 

the Pi9 ' “ 1S * t<>P l6Vel flowchart <* the method of 

the present invention embodied in Pig. 8 . 

of the Pi9 ' 14 iS a £1 ° WChart o£ tha docu ment generation 
f the present invention embodied in Pig. 8 . 

and n Pi9S ' “ ^ 16 ^ * fl °“ CharC o£ the scanning 
and processing by the na B ris „ 3 

g y he user s computer means of the present 
invention. F 8enc 

Pig. 17 is a flowchart of method used by the 
target server computer of the present invention. 

Pig. 18 is a flowchart illustrating the method f 

another embodiment of the Dr@si»n»- • ° 

cne present invention. 

Pig. 19 is an illustration of the data fo™,. „ 
encoding into a bar code for Pig. le . 


* 






enhanced remote control unit loof tV " * 
which i« sh Present invention 

shown scanning a machine readable symbol 12 which 

has been incorporated onto the face of a printed intel !! 
document 14. The machine readable symbol may comprise 
Uhear barcodes, two dimensional barcodes or other suitable 

WMCh °“ readil * >- scanned by various optical 
scanners well known in the art. 

The bar code symbol 12 is encoded with data 
representative of a location 

file to b. s * reS ° UrCe Suoh “ * data 

ixe to be accessed from a 

Irom a computer network such as the 
internet ,to be explained in detail below,. “* 

code symbol 12 may be encoded with an mternet ma. , 0n • f 
Resource Locator) such as "http://www sports o . 

up, 1 n u y ' ' ^ w * s P° r t8. com". This 

11 b6 USad * 8 a0fC “ a£a P^am such as a browser to 
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retrieve the file located at that Internet address. In this 
manner, print media may be encoded to allow a user to easily 
and automatically access, by scanning to be described 
herein, an on-line data resource. Thus, a user sitting at 
home and watching a television show on a "web-ready" 
television (i.e. a television additionally comprising 
Internet access means such as a modem, cable modem or the 
like) may be able to scan with the remote control unit a bar 
code related to that show, and the web-ready television will 
be caused to retrieve a data file whose content is related 

to the show. 

The scanner enhanced remote control unit 10 
comprises typical television remote control functions 
(volume, channel, power, etc.) in addition to housing a bar 
code scanning system. In the first embodiment, a scanning 
system 16 is distinct from the conventional data 
transmission system 18 that is used to transmit information 

to a television. 

Yariants of the first embodiment are achieved by 
substitution of alternative technologies for the scanning 
system 16. In a first variant the scanning system 16 is 
comprised of a one-dimensional laser scanner which is 
capable of scanning one-dimensional (linear) bar codes such 
as that shown in Fig. 4A. Such linear bar code laser 
scanning systems are well known in the art and may comprise 
a Visible Laser Diode (VLD) which is incident on a scanning 
mirror. The scanning mirror is caused to oscillate, thus 
causing the laser beam to sweep across a target bar code. 

The laser beam is reflected off the target bar code onto a 
photosensitive transducer, which generates a data signal 
whose amplitude varies in time as a function of the bars and 
spaces swept across by the scanner. In a second variant the 
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scanning system 16 is comprised of a two dimensional or 
rasterizing laser capable of scanning both one-dimensional 
and two-dimensional bar codes such as that shown in Pig. 4B 

the aT' T h raSCerUln9 are well hnown in 

thG sirt / and are similar fn 14 — 

1 ar scan ners except that the 
mirror oscillates in both the x and v , 

.v . w the x and Y P lanea which causes 

the laser beam to sweep in a raster pattern. 1 „ . third 

D . ^ the SCanning system 16 comprises a Light Emitting 

6 } ^ WhiCh Can Physically be swept by the user 

across one-dimensional bar codes in a * . ■ 

QMnri . dSS - In a four th variant the 

scanning system 16 comprises a linear, one-dimensional array 
Charge Coupled Devices (c®) which is capable of 

electronically scanning both one-dimensional bar codes and 

two-dimensional bar codes fhv m* ■, ■. d 

CCD „„„ y manually sweeping the linear 

CCD array over the bar code,. i„ . fifth varlant che 

scanning system l6 comprises a two-dimensional array of 
Charge Coupled Devices ,CCD, which is capable of 

electronically scanning both one-dimensional bar codes and 
two-dimensional bar codes, obviously each of these variant 

must be provided with the appropriate control and proc • 8 

software which is well known «- Processing 

well known to one skilled in the art. 

In order to access on-lin*» 

, n resources for which 

address and access information a* 

a mrormation is contained in the maohn-v, 

readable symbol 12 a user will first ^ 

90 a rst de P ress a scan button 

22 and pass the scanning system 16 acro« -w 

readshi A v , 088 the ma <*ine 

readable symbol 12 . Alternativelv 

y t the scannina svflhpm i c 

-y be invoked automatically without the need for depression 
of the scan button 2 2 whenever machine readable symbol is 

— ^ ^ SOam,in3 ~ * --it 

the;;; as tri " erw —- ■** * -u *»«„ ta 
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Fig.1C illustrates transmission of the captured 
image or pre-processed data of the machine readable symbol 
12 to the web-ready television 20 or television set-top 
conversion unit 20a by the scanner enhanced remote control 
unit. Upon depression of a transmit button 24 the image 
data captured during scanning is transmitted to the web- 
ready television or television set-top conversion unit by 
conventional techniques such as infrared (IR) technology, 
which is well known in the art of television remote control 
devices. It may be advisable to store less than 
substantially all of the machine readable symbol 12 scanned 
if transmission of the stored image begins prior to 
completion of the scanning process. This technique results 
in essentially a buffering function which is desirable where 
the machine readable symbol comprises a great deal of 
information for which it would not be feasible to store 
entirely within that quantity and density of memory found 
within a remote control unit comprising convenient 
dimensions for the typical user. Alternatively, the process 
of transmission may be invoked automatically upon successful 
scanning of the machine readable symbol 12, however, a delay 
would be required following the process of scanning the 
machine readable symbol 12 in order to provide the user with 
an opportunity to point the transmission system of either 
embodiments of the scanner enhanced remote control unit 10 
or 10A in the direction of the web-ready television or 
television set-top conversion unit . 

The transmitted information may be a raw digital 
data representation of the scanned image of the machine 
readable symbol, or it may be a fully or partially processed 
and decoded version of the machine readable symbol, or some 
form of intermediate data. Naturally, as the degree of 
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processing prior to transmission is increased, the 
intelligence contained within the ecanner enhanced remote 
control units 10 or 10A. in the form of hardware and 

software, must increase. However, this intelligence need no 
onger be resident xn the computer means associated with the 
web-ready television or television set-top conversion unit 
Thus, essentially a shift in the line defining the 
boundaries for locating various processing functions (e.g 
decoding the machine - readable symbol, and collating user 
demographic and publication source information) performed 
upon the information captured during scanning may be made. 
Naturally, such a shift can be made to best suit commercial 
an technological advantages of cost, manufacturing time 
space and reliability without exceeding the scope of the' 
invention. For instance, a great deal of processing 
resources may be located within the scanner enhanced remote 
control unit 10 or 10A and exercised prior to transmission, 
owever, this may lead to an expensive and cumbersome remote 
control unit which is prone to failure due to its freguency 

of use by various age groups of users under severe 
conditions. 

Pig.IB illustrates a second embodiment of the 
scanner enhanced remote control unit 10A of the present 
invention which is also shown scanning machine readable 
ymbol 12 embedded onto the face of the printed document 14 
The machine readable symbol may comprise linear barcodes 
two dimensional barcodes or other suitable codes. The 

scanner enhanced remote control unit 10A comprises a 

combination scanning and data tmuem• 

ata transmission system 18A which 

incorporates the functions of Wh n, 

"° th the scanning system 16 

n e transmission system 18 of the first embodiment of 
the scanner enhanced remote control unit 10 into one unit 
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which utilizes the same light source and potentially 
additional resources such as control and amplification 

circuitry and reflecting functions. 

In order to access on-line resources with the 

second embodiment of the scanner enhanced remote control 
unit 10A, for which address and access information is 
contained in the machine readable symbol 12, a user will 
first depress a scan button 22 and pass the combination 
scanning and transmission system 18A across the machine 
readable symbol 12 in order to capture an image of the 

4 

machine readable symbol 12 within the scanner enhanced 
remote control unit 10A. Alternatively, the scanning system 
16 may be automatically invoked without the need for 
depression of the scan button 22 whenever machine readable 
symbol is encountered by the scanning system 16 just as with 
the first embodiment. After the bar code symbol 12 has been 
scanned, the data therefrom is transmitted by conventional 
IR means by the combination system 18A to the IR receiver 
associated with the web-ready television or set-top 
converter box. 

Figure 8 illustrates a more detailed block diagram 
of the system of the present invention for generating and 
reading the intelligent document 14. The system comprises 
an intelligent document generation system 11, which encodes, 
assembles and prints an intelligent document 14 for 
subsequent scanning by the scanner-enhanced remote control 

unit 10. 

The system operates as follows. A vendor who 
wishes to provide an intelligent document 14 (that will 
enable a television viewer to automatically link to an 
Internet resource while viewing a television show) programs 
certain parameters which will be encoded within a machine- 
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dable code 12 and printed on the document along with text 

or graphics. The document may be an advertisement in the 

form of a magazine insert or page, a brochure, or a 
television schedule book. 

Parameters to be included within the machine- 

readable code depend upon the application desired by the 

vendor. For example, if the vendor wants ^ 

. , or wants the end-user to be 

a e to access the vendor's world wide web (WWW) site 

IncZ t d iCaU V POn 8Camiin9 the 0Od8 “' th “ parameters 
eluded in the machine-readable code may include a command 

to launch an Internet browser application o, u 

PPJ-ication, such as NETSCAPE, 

a uniform resource location (URL) code, such as 
^rtp: //www.xyzeorp. com. This information is encoded in 
accordance with the particular type of machine code being 
ueed. For example, one type of code which may be used by 
the present invention is a PDF417 symbol, which is described 
e ail in O.S. Patent Ho. 5,304,786, which is 
incorporated by reference herein. The PDF 417 symbol, known 
as a two-dimensional bar code symbol, has enough storage 

information to encode the browser launch 

the URL. wowser launch command as well as 

desi „ * Prlnter 30 th * n Utlli2eS the “=°ded ^ta and 

ired text and graphics to print the int.i i • 

14 as shown in the Figures. document 

end • The intelU9ent d ° Cumenc 14 is disseminated to the 
end user in accordance with the methods desired by the 

vendor. For example, if the intelligent document is a 

elevision schedule, then the user win obtain the schedule 

y conventional means such as purchase at a retail outlet 
the mail, etc. “tj.ee. 


The user, 
the document, can 


reading the text and graphics in 
the WWW site of the vendor by 
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utilizing the scanner-enhanced remote control unit of the 
present invention in conjunction with the computer means 
associated with his web-ready television or set-top 
__ orogrammed with appropriate software in 


accordance with the invention. 

After the bar code data is scanned by the scanner 

16 as previously described, a decoder 36 is used to decode 
the raw data into usable commands and data. The decoder is 
typically a software program executed by the microprocessor 
of the computer means or resident on the scanner - enhanced 
remote control unit, and provides thereby the browser launch 
command (optionally) and the URL which had been encoded by 
the vendor into the code. The WWW browser application is 
then loaded, and the URL is used to access the WWW site of 
the vendor accordingly. As a result, the user may 
automatically access the vendor's WWW site without having to 
enter the URL, thus eliminating all chances of error due to 


manual data input. 

The above scenario is useful when a vendor prints 
and distributes such intelligent documents such as web- 
enhanced television schedules on a mass scale. That is, the 
code distributed is the same for each user. In an 
alternative embodiment, specific user data is included with 
the code to provide for personalized operation as follows. 
This scenario is useful when the vendor makes individual 
printings keyed to individual users, such as when mailing 
labels are printed for inclusion on an envelope surrounding 

a television broadcast schedule or the like. 

In this case, the vendor may include in the code 

personal data such as the user's name, location, phone 
number, and other appropriate demographic information which 
be scanned and held in a temporary buffer for use with 


may 
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subsequent program-related bar code scans. when che ueer 

dOCUmenC and ^ "" the persona! data 

e scanned user-specific bar code is uploaded to the 

ven or-s host computer, thus providing the vendor with 

useful demographic data as to which users h* 

nicn users have actually 

1 l2ed the lntelli 9 ent document scanning service. 

useful i„ 11,6 r may alS ° inClUde Se0UrUy lnfo ^tion 

_ CO " Pletlng — transfers across the Internet 

or example, an encryption key appropriate in a public or 
Private key system may be embedded within the code “ 

approbate software routine in the user ' s computer utilizes 

the key after decoding it in order to „ 

,, 3 oraer to encrypt certain data 

mg sent across the Internet. For examola m, 

<* card information is desired a enCrYPti °" 

_ aesired in order to thwart- 

would-be intruders from misappropriate t-h • . 

SySte " ° f ^ Pr ' Sent invention could be used to allow 

the user to order an item by taking the credit ca a 
already resident- 5 credit card number, 

encrvot' U8er ' 8 C °" PUCer me ”°ty, and 

encrypting it with the key decoded from the code when th 

user desires to purchase the item k. ' 

code, and the credit card numbe ■ aS80Ciated 

after the WWW site i. r “ enC ° ded “ d tra ”smitted 

the user's name (sent with the trans • • matCh 

cn zne transmission) with the 

ppropnate decryption key stored at the host and d 

the credit card number accordingly. ^ 

function JT 6 ’ ^ “ U1UStratl ° n of a ” obfuscation 

f the present invention. Prior to h.- 

the symbol data strioo ^ 3 encoded . 

aata string may optionally be obfuscates • 

tC the eecurity aspects of the sys m 

data strinrr • • system. The symbol 

Which the lnPUt lnt ° 8 Che0ltSU " COrapUting “tans «, 

then computes the checksum of the symbol data stf 

“ aC ° 0rd8nC8 - — - -wn inle 
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The computed checksum is then used as 9 key in an encryption 
scheme 66 which may be one of several well known encryption 
methodologies known in the prior art. The key 64 is 
assembled in the clear (i.e., unencrypted) along with the 
encrypted symbol data string into by the encoding function 
29. After this encrypted data string and cleared checksum 
data is encoded, it is rendered by the printer 30 in 
accordance with methods well known in the art and the 

intelligent document is thereby generated. 

After the intelligent document 14 is distributed 

to the user, the bar code symbol 12 is scanned by the 
scanner-enhanced remote control unit and processed as 
follows. The scanned symbol data is decoded by means well 
known in the art in accordance with the particular symbology 
implemented to encode the symbol 12. Once the symbol data 
has been decoded, it is de-obfuscated (if the original 
symbol data had been obfuscated as described above) by de - 
obfuscation function 37 which is illustrated in detail in 
Figure 11. First, the clear checksum 64 is utilized as a 
key to decryption function 97 to decrypt the encrypted 
string 67. The decryption function 97 which was preloaded 
onto the user's computer means as part of an initialization 

4 

process with the system is a corollary to the encryption 
function 66. By passing the checksum 64 in the clear and 
utilizing it as the key, it enables the user's computer 
means and document generation computing means to be 
synchronous with respect to the encryption methodology. 
After the decryption function 97 produces the clear data 
string comprising the original file location pointer 21, 
launch command 22, user demographics 23, source ID 24, key 
25 and code type 26, then the checksum computing means 99 
operates to compute a checksum of those fields. That 
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computed checksum is then compared by comparison block ioi 

w h the received clear checksum 6< tha t was decoded by the 

decoding process 36. if the enmna • 

. .. omparison process 101 

indicates that the computed checksum i . 

clear . cnecksum equals the received 

Checksum, then go/no go signal 103 indicates that the 

transmission and decryption process was successful 

If. however, the checksums are not favorahlv 

the go/no go signal 103 will indicate a then 

. aicate an unsuccessful 

ransmission and decryption process, if thi , u 
unsuccessful, then further processing is aborted. 

Once the symbol data - 

parsed by parsing M , ^-obfuscated, it is then 

by parsing block 39 in order to utilize the 

constituent fields as follows. The file local • 

and source identifier string 24 . ^ P ° inter 21 

. tring 24 are assembled into a 

register that will comprise the file transf 

file tranofem 1 transfer request. The 

transfer request register is also loaded with a c, ■ 

version 7 2 taken from local memory 70 on the 

means. The user demographic string 2 3 • * 0C "" puter 

into an encryption block eo which is th " ° Ptl ° nally fed 

wmcn is then used with 

encryption key 25 to encrypt that data and put the result 

as encrypt user infection 63 into the file trans 
request string 90. Optionallv 

^ iocal user'data “ 

nr 70 of the — ~ ~ "I ;r 

naer data may comprise sensitive inform.^ ' 

user's credit u information, such as the 

edit card number. Advani-a« A i 

this information the user will have 
confidence that this sensitive information can be 

etansmitted over the internet for applications such as 
tronic commerce. Thus thf» f-ji 

register 90 transfer request 

egister 90 will comprise the file locaMc • 

6 ■ Loc ation pointer 21 , the 
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client version 72, certain encrypted user information 82 and 
the source identifier 22. 

The code type string 26 is compared by block 78 to 
the internally stored code type 76. If the comparison is 
unsuccessful, then further processing is aborted. This 
process is useful to enable certain versions of the client 
software to be distributed such as on a demonstration or 
trial basis, and this trial software will only work with 
certain documents generated by corresponding document 
generation software modules. Thus, a user having a trial 
version will not be able to fully utilize the system until 
it purchases by license or otherwise the production version. 
Utilization of this type of code type matching also enables 
the system vendor to control expired licenses, etc. 

Once the file transfer request has been 
successfully assembled, it is then sent to the appropriate 

interface in order to obtain the requested file. In the 

/ 

preferred embodiment, the file transfer request will take 
the form of a uniform resource locator (URL) which will be 
sent to the Internet browser software 40 that is associated 
with the user's computer means. 

Referring to Figure 12, the operation of the 
target server computer will now be described in detail. 

When the file transfer request 90 indicates that the file to 
be retrieved is located on an Internet file server, then the 
file location pointer 21 will comprise a URL, which 
comprises an IP address (Internet Protocol), as well as a 
file identifier. The IP address, as is well known in the 
art, is the address of the target server computer on the 
Internet. The Web server program 112 that is running on the 
target server computer 46 receives the URL over the Internet 
44 and strips out certain parameters contained therein. The 
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source identifier 24 is used to access a ice* up tabie 110 

Whrch comprises a plurality of source identifier strings and 
their associated decryption tu • j 

crypcion keys. This decryption key that 

is obtained from the key table no is then used by 
decryption block 114 to decrypt the encrypted user 
information received in the file transfer request. 

Decryption function 114 is fo-mi i« 

« xj. 4 is corollary to the encryption 

function 80 performed at the user's computer means. Thus 

the secure information transferred with the file transfer' 

request is decrypted and user information file 122 may be 

stored in user log S2. along with the date and time stamp 
120 to indicate when the nart--ir.„i „ 

ne Particular request was received, 
information is quite valuable to the vendor, since it 
enables it to determine the name and other useful 

information relating to users who have accessed its Web 
site. This information may also be utilised by file 

file or fn * u dynamically determine the 

files to be sent back to the user's computer means 

P=r example, if the demographics data indicates that the 

user would prefer the file returned back in a language other 

than English, that file can be accessed or generated 

appropriately. Thus, in addition to retrieving a static 

Page stored in the target server ™ 

. ® r com P ut er, the system of the 

Present invention allows dynamic generation and return of 
puter files m accordance with user's preferences 
indicated in the transfer request, m addition, as 

escribed herein, if the user has allowed his credit card 

number to be encrypted and sent with the file transfer 

request, then the target server 

^. 9 server computer can decrypt the 

credit card number and utilize it to n® e 
,. „ lze it to perform a secure on¬ 

line transaction. 
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in Che alternative to having a file resident on 

the target server computer, it may be required 
target server computer to access an auxiliary file server 
lie to get the external file and return it back to the 
user . s computer means. The auxiliary file server lie may be 
accessed directly, through a dial up modem connection, or 
through the Internet. In addition, an external key server 
116 is accessible by the target server computer if it is 
desired by the system designer to keep the key table 110 
remote from the target server computer, rather than local 
therein. By. keeping a key table 110 at a central server 
location, the system provider can keep track of server 
requests to decrypt user information and charge a fee 
accordingly. Thus, a vendor utilising this system may have 
the option of paying a per click fee to determine the user 
demographics of each user that accesses his server or may 
just provide files back to the user without obtaining that 

knowledge on a less costly basis. 

When the file is returned back to the user's 

computer means through the Internet 44, it may be displayed 

in a manner well known in the art on a television screen via 

the internet browser 40. Thus, the system of the present 

invention has provided an easy and error proof way for a 

user to obtain a computer file from an Internet server 

computer and displaying it to a television screen by simply 

scanning a code provided on an intelligent document and 

having the client automatically process the code, request 

the file wherein the file is then returned by the target 

server computer and displayed to the user. 

Figures 13 through 17 illustrate the flowcharts of 

the methodologies employed by the present invention. Figure 
13 is an overall flowchart wherein step 202 illustrat s the 
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l a l a an T in9 c r sin9 the file location 

c ;? vr rr aphics ' source ** -— 

VP*. At block 204. the data string is utilised to generate 
an intelligent document 14 which is ai 

^ . h also distributed to th* 

«d users. At step 208, the bar code svmbol • 

« step 210 the data is decoded and “ 8Can ” ed ' “* 

remjeat. • and Pressed and the fi le 

request is assembled. At step 212 the file e 

. * x<s cne tile request is 

ransmitted over the Internet and at 

1 ancI at step 214 the taroet 

server retrieves and/or generates ^ 

g nerates the computer file 

requested. Final! v 

inaily, at step 216 the file is . 

the noov'o e 1S tran smitted to 

the user s computer means and displayed nn *k w 
the user. ls Piayed on the browser to 

‘giare 14 is a more detailed flowchart of the 
document generation procedure. The data string at 202 i 
used to compute a checksum at step 218 a. 

checksum is used to encrypt the data string ^.t^t ^ 

:;t : d ™ -*•— 

p the bar code symbol is encoded and at step 226 the 
bar code symbol is printed with optional text and l 
onto the intelligent document 14 . graphics 

Figures IS and 16 illustrate the detailed 
operation of the u«r< e detailed 

Figure is th Tl COmPUtEr "a" 8 - At «ep 208 in 

' ar code symbol is scanned. At step 218 th 
J^t data String is parsed i„ order to de J 

“ d “ 18 the " d ~™ the checksum as the key 1 

decrypted string is used to computer „ v „ ^ 

received checks.™ t P ter a checksum and the 

checksum is compared with t-ho „ 

« the checksums are not equal an 

declared and M, lnValid “"^tion is 

and the process exits at step 230. if data ls 

indicated valid at step 232. then the stored cod 

retrieved from the client's me type is 

client s memory at step 234 a 

comparison of the code . * A 

e coae type from the clienh 

‘e Client memory with the 



WO 98/51036 


PCT/US98/09413 


received code type is compared at step 230. If an invalid 
data condition is indicated in this test, then the process 
exits at step 230 and if the code types match, then the 
process continues with an unpacking of the decrypted string 

at step 238. 

Referring now to Figure 16, the step 240 will 
encrypt the user data file from the client memory and 
optionally the user demographics received from the bar code 
to generate an encrypted user file. At step 242, the 
encrypted user file is assembled into the file transfer 
request 248. At step 244, the file location pointer 
comprising the IP address and file ID and the source ID are 
also assembled into the file transfer request and at step 
246, the client version is retrieved from local memory and 
assembled into the file transfer request. At step 250, the 
browser is provided with the file transfer request and is 
optionally started by the launch command in the received 
string. At step 252, the file transfer request is 
transmitted to the target server, preferably in the 
preferred embodiment over the Internet in order to obtain 

the requested file. 

Figure 17 illustrates the details of the 
methodologies employed by the target server computer. At 
step 254, the target server computer receives the file 
transfer request, and at step 256 the Web server program 
running on the target server computer uses the received 
source identifier to retrieve the associated decryption key 
which may be internal or externally located. At step 258, 
the user file is decrypted and the user data is stored in a 
log. If the static page has been requested by the user, 
then the file location is looked up as a function of the 
file identifier. At step 264, the file is retrieved from 
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that location at step 268 and returned to the user's 
computer means via the Internet at step 270. if the 8Catic 

page was not requested at block 262, then a dynamic page is 
generated at step 266 which typically will be a function Qf 

e lie identifier and/or the user data that had been 
received and decrypted. Again, the file is then ^ 

e user s computer means by the Internet and displayed on 
the user's browser at step 272. 

Figures 16 and 19 illustrate an alternative 
embodiment for encoding the Internet resource information 
a mear (one-dimensional) bar code (an Internet hot- 
inh. useful with the scanner-enhanced remote control unit 
e present invention. Referring to Figure 18 , the 
document 14 embedded with an Internet hot-li„k bar-code 12 

desIribeT" ^ 3 9eneratl ° n ^ “ piously 

doc The flrSt Step ° £ the prooess takes place in the 

a cT nt vT ratl0n Stati ° n “ hiCh *°»atting of 

onto thT l09y aUCh 38 3 ^ C ° «- P^ted 

onto the document 102. Prior « • *. • 

the printed d Printing the bar code on 

cne printed document 102 , a host int-ov^*. n 

osc In ternet Protocol (ip) 

address related to the tarrun- a 

cne target server 124 (the software uh 

rnns c n ehe host computer ^ ^ ^ ^ ^ 

a ocument) is designated following standard TCP/ip 8vnt 
and a specific port is identified in step i of Fi^e ~ 

efault port for the host computer 120 has not been 
assigned. Similarly, process values representing 

retu^eTr T™ 0 " “ d Predetermined responses to be 

Both tar9et SerVer " e defi "ad in step 2 

sets of information are expressed as binary strinos • 


^ A 
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(e.g. data compression) . An example of the binary string 

format is shown in Figure 19. 

Thus, the data to be included in the bar code 

12 to be printed in the document 14, as shown in Figure 
19 , includes the target server IP address in the 
aa.bb.cc.dd format, the (optional) port number, and 
data to indicate to the target server 124 which file 
should be sent back to the user's computer means. 

Optionally, the server file ID field may be 

omitted, which will allow a smaller bar code symbol to be 
utilized, in this case, the target server computer will 

return a file found at a default location. 

The resulting binary string or token is then 
encrypted, obfuscated (rendered obscure through a cipher or 
other non-encryption technique) and optionally signed with 
an encryption key in step 4 of Figure 18. Alternatively, a 
hashing function could be performed upon the token and the 
result used as a digital signature appended to the printed 
document. The proper decryption, de-obfuscation or 
signature verification is subsequently performed by the 
user's computer decoding software to confirm that a licensed 
party generated the token. The token is then converted to 
an ASCII string in step 5 which is then converted to the 
standard syntax of a machine readable code in step 6 such as 
a linear barcode. The machine readable code is then 
rendered as a component of the printed document 102 in step 
7. The printed document 102 is then ready for distribution 

and circulation. 

The next step of the process takes place in the 
scanner-enhanced remote control unit which is adapted to 
scan the machine readable code as previously described. The 
user's computer means then processes the data from the 
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scanner-enhanced remote control unit, and utilizes a stored 
ecryption key to decrypt the data and verify its 

authenticity. 

The decoded ASCI! string is then converted tQ 
corresponding binary equivalent in step , and is decrypted 

~ -». z ... 

party In t 

Party ln step 10 which results in a token. 1, the token 
thus derived is not valid as determined in step 10 the 
retrieval process is terminated in step 12 . 

However, if the token is valid, it is expanded to 
reconstruct the IP address and port, document and process 

T " WhiCh ^ C ° ^«d 

infZt r the t8r9et SerVer - D8S9e and ^raPhic 

formation descriptive of the user-a computer means may 
lona y be retrieved from memory and encrypted 
obfuscated and signed in step 22 using a key 25 plovided by 

is 2 ^ in£0rT " ati0n suiting from step 21 

ociated with the extracted IP address and port, 

ulriT r e8S ValUe8 £r0m SUP “' and then formatted 
session , “ aPPr ° Prlate for an Int a™et communication 

session ,e.g. WWW, html, thereby enabling a query to be 
asserted in step 14 . 

' The query is transmitted onto the Internet by the 

s computer means in conjunction with an Internet 

communication module such as a web browser. After being 
routed to th® i_ oeing 

techn • COmpUCer via standard Internet 

echniques, the query is unpacked and parsed by a 

communication module and server in step is. 

The target host computer then activates rh„ 
file which retrieves rhs - Che serv er 

or «. the reqU6Sted ^formation from storage 

or generate the requested infftrmaH' . ^ 

quested information using programmed 
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retrieval and formatting processes (e.g. CGI, RDBM) in step 
16. In one embodiment static preformatted information (e.g. 
html), RDBMS elements and CGI and RDBMS scripts are stored 
on a local host database 18, however, such information could 
also be stored on an appropriate device accessible through 
structured data communications with the host including the 
client. These transactions can also be logged in step 17 
for subsequent analysis concerning traffic and 
reconciliation with licensing charges. The retrieved or 
generated information is then formatted for transmission to 
the user computer means and transmitted using appropriate 
protocols (e.g. TCP/IP) in step 19. This information is 
then displayed to the user on the television screen and a 
screen dialog between the user and the information system 
proceeds. A portion of the content or format of the 
information presented to the user could be tailored to the 
individual user based on demographic and usage information 

conveyed in the original query. 

Alternatively, the query information, particularly 

the demographic and usage information, may be stored in the 
form of an activity log in step 23 on a separate server or 
as an activity database 24 on the host computer. In the 
case where the activity database 24 is stored on the host 
computer the activity database 24 is encrypted and the 
information is retrieved for marketing or some other purpose 
in step 26, and decrypted in step 27 using the access key 25 
which would generally be under the control of the licensing 
party and provided under commercial licensing terms. 
Following decryption this information could then be 
displayed or printed in step 29 or stored in step 28 for 
future analysis and use by the licensed publisher or vendor. 


~>n 


30 
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Fig.2A illustrates a third embodiment of the 

scanner enhanced remote control unit 10B of the present 

invention which is shown scanning the printed document 14 

The scanner enhanced remote control unit 10A comprises an 

P al character recognition scanning system 16A which is 

distinct from the transmission system 18 used to transmit 

information to a web ready television or television set-top 

conversion unit, personal computer 20b or any other system 

adapted for access to on-line resources ,i.e„ comprising a 
browser and a modem). 

In order to access on-line resources with the 

third embodiment of the srsnnov , 

canner enhanced remote control unit 

OB. for which address and access information is contained 
on the printed document 14. a user will f ir st depress a scan 
utton 22 and then pass the optical character recognition 
scanning system 16A over the printed document 14. 

tively, the optical recognition scanning system 16A 

I;— 1 : 11 " be inVOk6d " ithOUt the " Sed ** depression 
of he scan button 22 whenever printed matter is encountered 

y the optical character recoonitirm 
however thi= , 9 scanning system 16A, 

ever, this may lead to false or incomplete scans. 

sub t Variants of ^e third embodiment are achieved by 
substitution of alternative technologies for the optical 

c aracter recognition scanning system 16A. For instance, 

he optical character recognition scanning system 16A may be 

comprised of a two-dimensional array of charge coupled 

IZT 1 * of “ 9 a wide —* ° £ «« 

assuming the appropriate control and processing software is 
Provi ed which is well known to one skilled in the art. 

Pig.2B illustrates transmission of the captured 

image data representative of ►», i . P ° 

of the location of an on-line 

resource to a personal computer 20 b m «-* • 

mpucer 20 b. in this embodiment, the 
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PC 20b is used, rather than a web-ready television set, for 
accessing the online resources while the user is located 
remotely from the PC 20b (i.e. across the room). Thus, the 
user can scan and access on-line resources without having to 
be physically in front of the PC (i.e., without being at the 
keyboard), and without having to manually type in the access 
(i.e. URL) information. Of course, the PC 20b must be 
adapted to receive remote control data to be utilized with 
the scanner-enhanced remote control unit of the present 
invention. As shown in Figure 2B, the PC may have 
associated therewith an IR sensor 100, which is adapted to 
receive scanned URL information and use it with a web 
browser to retrieve the associated file from the Internet. 

It is noted that the PC embodiment described herein is 
particularly well suited for use with the optical character 
recognition embodiment of this invention, wherein processing 
and memory requirements are relatively greater than m the 

bar code scanner embodiment. 

Fig. 3 illustrates a block diagram of the third 

embodiment of the scanner enhanced remote control unit 10B 
which is essentially applicable as well to the first and 
second embodiments and their variants except for the 
substitution of the optical character recognition scanning 
system 16A and its associated scanning system control 
interface 26 for the scanning system 16 of the first 
embodiment or the combination scanning and transmission 
system 18 of the second embodiment. The outputs of the scan 
button 22 and transmit button 24 (assuming that these 
buttons are present) are monitored at the input/output ports 
28 which translate the depression of either button into a 
signal which is then passed to a control, recognition and 
decision logic block 30 via an interrupt, polling routine or 
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alternative technique well known in the art. The 

input/output ports 28 are tyoicallv o™ , 

yP cail y comprised of content 

a leasable latches and registers. The control, recoonit• 

and decision logic block 30 is f-vrT 1011 

9 CK 30 ls typically comprised of a 

microprocessor with additional programmable logic and 
support integrated circuits (e o 

interrupt controller. 

oscillator*, buffers pt-n \ an j 

tats, etc.) and operates according to a 

predetermined program resident in program memory 32 The 
program memory 32 is typically comprised of some type of 
non-volatile memory storage integrated circuits such as 
H —»y. ~ electrically erasable prom , EE p R0M) . T he 
control, recognition, and decision logic block 30 stores 

temporary variables along with a rfirr^- j 

• , digitized version of the 

scanned image (whether it be scaring ^ 

. _ scanned from machine readable 

symbol 12 , as shown in Fig ia nr- « • 

in Pio ». • P nted maCter es shown 

9. U> i„ a temporary storage area 34. The temporary 

age area 34 typically comprises static ram (ram, or ■ 
ynamic ram (DRAM) if manufacturing costs are a significant 
consideration. The input/output ports 23 also provide data 
an control signal interfaces between the control 
recognition and decision logic block 30 , the sca^ino 

control interface 26 and the transmis • ,y * t " 

36 transmission control interface 

In the first embodiment of the scanner enhanced 
-o e control unit 10 the contents of the transmission 
o interface 36 and transmission system ie are well 

vh Z “““ ^ “ Sh ° TO the ~ quantity of units 

c °mmercially available. Similarly typical 

cements in the contents of the scanner system control 

art a„d l “* 8 ° am,in9 ^ « Che 

S 243 If ^ °' S - Pat6nC N ° 8 - and 

• 3,655 which are hereby incorporated by reference In 
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15 


the second embodiment of the scanner enhanced remote control 
un it 10A the transmission control interface 36 and 
transmission system 18 would be required to perform both the 
scanning function and the transmission function. It is 
anticipated that either one or a combination of charge 
coupled devices (CCD), radiation emitting diodes (e.g., 
laser, infrared or some other band of the spectrum), or 
another suitable technique well known to those skilled in 
art would be used with control and interface circuitry 
adapted to modulate between the two functions. The 
following references provide information on charge coupled 
devices and are hereby incorporated by reference: 

1. G. F. Amelio, rharae-counled Devices 
Scientific American, 230(2);22-31, 


February 1974 
2. F. Bower, £d 


Fairchild 


Camera and Instrument Corp., February 


1978. 


20 


25 


Machine readable symbol 12 may be rendered in any. 
of a variety of bar code formats. A bar code symbol is a 
pattern comprised of a series of bars of various widths and 
spaced apart from one another by spaces of various widths, 
the bars and spaces comprising different light reflective 
properties. The bars represent strings of binary ones and 
the spaces represent strings of binary zeros. Generally, 
the bars and spaces can be no smaller than a specified 
minimum width which is defined as a module or unit. The 
bars and spaces are multiples of this module size or width. 

Bar code symbols are typically scanned by optical 
techniques, such as one-dimensional or two-dimensional 
scanning laser beams, wands or Charge Coupled Devices (CCD), 


30 
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and the resulting electrical signals are decoded into data 

representative o£ the symbol (or further processing, it ie 

anticipated that such techniques would be used in the 

scanning systems 16 and 16A as well as the combination 

scanning and transmission system 18A of the present 

invention. One and two-dimensional bar codes of the prior 

art are illustrated in Figs. 4A and 4B, respectively, and 

are disclosed in greater detail in o.S. Patent 

Nos.5,243,655; 5,471,533; and 5,399,846, which are hereby 
incorporated by reference. 

Optical Character Recognition (OCR) is the 
technology of using machines to automatically identify 
human-readable symbols, most often alpha-numeric characters 

and then to express identifiers in deters, 

aencitiers m machine readable codes 

The operation of transforming numbers and letters into a 
form adapted for electronic data processing is an essential 
method of introducing information, such as address and 
access to on-line resources by the optical character 

recognition scanning system 16A of the present invention, 
into computing systems. 

In •» OCR system comprises the following 

blocks; input, transport, scan, preprocess, feature 

extraction and classification logic, and output. The 

transport function as applied to the optical character 

recognition scanning system 16A of the present invention 

comprises the passing of the scanner enhanced remote control 

- 10B over the printed ^ ^ ^ 
matter relevant to on-line resources. The transport 

2 n::rv lso co,nprise the depressi ° n «* «*• ~» 

“ order to invoke scanning unless this function is 
automatically invoked. 
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The scanning function converts reflected or 
transmitted light into an electric signal which is then 
digitized by an analog-to-digital converter (ADC). Although 
less complex, transmitted light scanning requires the 
additional step of making a transparency of every image to 

be scanned. 

Optical scanners either employ a flying spot or a 
flying aperture principle. In the first instance a spot of 
light sequentially illuminates successive portions of the 
image to be scanned, and all the reflected or transmitted 
light is collected by a detector. In flying aperture 
.devices the entire document is flooded with light, but light 
is collected sequentially spot by spot from the illuminated 
image. An example is Vidicon® scanners in which a document 
is flooded with light from an ordinary light source, and the 
reflected or transmitted light impinges upon the 
photoconductive target of the Vidicon®. The image on the 
surface causes a variations in the local charge 
concentration, which is converted into a video signal by 
sequentially scanning the photoconduct ive surface with an 
electron beam. Mechanical scanners, television cameras, CRT 
flying-spot scanners, solid -state linear and two- 
dimensional array scanners, and electrooptical scanners 
which use a laser as the source of illumination are the 
techniques primarily used in commercial applications. 

In solid-state scanners the image is scanned by 
electronically switching between adjacent areas scanned by 
different elements in an array. Flying spot devices use 
linear on-dimensional or two-dimensional light-emitting 
diode arrays. Flying aperture devices use arrays of 
photodiodes or phototransistors. The most commonly used 
scan pattern is a raster scan in which the flying spot or 
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flying aperture sequentially scans the character area by 
using a sawtooth pattern. Due to the use of microprocessors 
in the scanner enhanced remote control units 10 , ioa, and 
10B of the present invention, complete programming of the 
scanner is feasible which makes it possible to rescan 
rejected characters, and to scan blank areas at low 
resolution in order to increase throughput and perform 
additional preprocessing functions in parallel. 

The preprocessing function typically comprises 
line finding, character location and isolation, 
normalisation and centering, and other function that may be 
needed prior to feature extraction and classification. The 
nature and degree of preprocessing required depends on 
Whether the printed document 14 to be scanned is comprised 

Of stylised fonts, typescript, typeset text, or hand printed 
characters. 

Stylised font characters of the prior art, such as 
those illustrated in Pig. s, have well-defined and 

controlled formats and spacing. Documents using stylised 

font characters generally also have special symbols to guide 

the scanner to each field of information. Special ink, 

invisible to the scanner, is used to print material not to 
be scanned. 

Software capable of performing line finding 
algorithms compensate for baseline drift in the lines of the 
printed document 14. where characters are not uniformly 
spaced or in which easily detectable boundaries do not occur 
where expected, character segmentation may involve a 
scanning aperture that is smaller than that used for the 
subsequent classification function. A number of heuristic 
algorithms are available and well known in the art to 
separate touching characters, liminate noise such as 
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isolated dots, and smooth out gaps or breaks in line 


segments. 


The amount of rotation and skew correction. 


character segmentation, size normalization, centering, and 
noise elimination available on individual characters prior 
to classification determines how sophisticated the feature 
extraction and algorithms must be for a given application. 


Many commercial applications simply employ a template 
matching technique which provides adequate performance only 
if variation of the above types have been essentially 


eliminated. 

Recognition is typically achieved by extracting 
distinctive features and using them in a decision logic to 
classify the characters. Decision logics are designed by 
using statistics of features obtained from sets of learning 
samples representative of the intended applications. 

Optical correlation, resistor summing networks, 
and parallel digital logic circuits represent some of the 
ways in which character and feature templates and weighted 
masks have been implemented in hardware. Centering of the, 
character being scanned within a recognition window, 
referred to as registration, may be done by shifting the 
digitized character through a discrete number of successive 
positions in a one or two dimensional shift register. 
Approaches to segmenting a line of print into individual 
characters include comparing successive vertical scans to 
give an explicit segmentation of the entire line or 
alternatively looking for peaks in the output of the 
classifier to implicitly segment each character. For a more 
complete discussion of the contents typically found in the 
scanning system control interface 26 and optical character 
recognition scanning system 16A well known to those skilled 
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hereby incorporated 


1- N. Ahuja and B. j. Schacter, 
Models, 1983. 

2- K. s. Pu, 




, 1982. 

The following represents a discussion of tho 
concepts relating to the internet and 
resources required for an a ° n - line 

invention. The world Wide'wer'* 3 ”'* 1 " 9 ^ PreSent 

repository of inforuj n tl “ “ 

uon fc hat is accessed with 
interactive browser a k th 

informs ■ browser dl8pl *ye * Page of 

nformation and allows the user to move to anoth 

making a selection using a point ■ a Page ** 

y 3 pointing device ahoVi - 

or by transmitting the scanned • h * m ° USe 

embodiments of the SMnr , 5 d ln any of the 

- -.»- - :r; rrr*-—- 

Web documents are wrin-£»„ i . . 

language (HTML,. In addition ^ *»■“-*« Markup 

t398 that document layout and'’fo^tt Z 

cause an Immediate change, while othe tags 

®PPly an action to multiple it “* “ S * d ln pairs to 

„ “itiple items. Because an htmt ^ 

uses a textual representation, images are not ■ “ 

Erectly in . document. Ins tead a J , 
document to specify the plane at which an ^ ^ 
inserted and the source of the imag e Sh ° Uld ^ 

“ HTML document whLh^orres^nd ^ ^ ^ *" 

-*——-ri:. “irr reference - 

" * “ * - — • Because 
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include arbitrary items, a selection can correspond to a 
picture or an icon as easily as to text. 

External references are given in the form of a 
Universal Resource Locator (URL). Such a URL would be 
contained in the machine readable symbol 12 shown in Figs. 

1A and IB or the printed document of Fig. 2A as address and 
access information to on-line resources. A browser within 
the web-ready television, television set-top conversion unit 
or personal computer 20b would extract from the URL the 
protocol used to access the item, the name of the computer 
on which the item resides, and the name of the item. A URL 
that begins with http:// specifies that the browser should 
use the Hyper-Text Transport Protocol (HTTP) to access the 
item; the browser can also use other services such as File 
Transfer Protocol (FTP). 

The browser consists of a controller, one or more 
clients used to access documents, and one or more 
interpreters used to display documents. Each browser must 
contain an HTML client to retrieve Web pages and an HTML 
interpreter to display them. In addition, the browser can 
include clients that permit access to services such as file 
transfer or electronic mail, and interpreters that display 
documents that use representations other than HTML. 

To make document retrieval efficient, the browser 
uses caching. The browser places a copy of each document or 
image that the user views on the local disk. Whenever the 
document is needed, the browser checks that cache before 
requesting the document from the server on the network. 

Most browsers allow users to control the length of time 
documents are kept in the cache as well as other control 
parameters. 
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When a browser interacts with a web server, the 

two programs follow the HTTP, m principle, HTTP is 

straightforward: it allows the browser to request specific 

items, which the server then returns. To ensure that 

browsers and servers can interoperate unambiguously, HTTP 

defines the exact format of requests sent from the browser 

to the server as well as the format of replies that the 
server returns. 

Browsers have a more complex structure than Web 
The server performs a straightforward task 
repeatedly: the server waits for the browser to open a 
connection and request specific pages. The server then 
sends a copy of the requested item, closes the connection. 

and waits for the next connection. The browser handles most 
of the details of document access and display. 

Consequently, the browser contains several large software 

components that work together to provide the illusion of a 
seamless service, 

Conceptually, the browser comprises a set of 

clients, a set of interpreters, and a controller that 

manages them. A controller forms the central piece of the 

browser. It interprets inputs from the scanner enhanced 

remote control unit 10, 10A or 10B, and calls other 

components to perform operations specified by the user. For 

example, when the TOL is transmitted by the scanner enhanced 

remote control unit 10, 10A, or 10B, the controller calls a 

client to retrieve the requested document from the remote 

server on which it resides, and the interpreter to display 
the document to the user. 

Each browser must contain an HTML interpreter to 
display documents. other interpreters are optional. input 
to the HTML interpreter consists of a document that conforms 
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to the HTML syntax. The output of the HTML interpreter 
consists of a formatted version of the document on the 
display of the web-ready television, television set-top 
conversion unit or personal computer 20b. The HTML 
interpreter handles layout details by translating HTML 
specifications into commands that are appropriate for the 
various display. For example, if it encounters a heading 
tag in the document, the HTML interpreter changes the size 
of the text used to display the heading. Similarly, if it 
encounters a break tag, the HTML interpreter begins a new 

line of output. 

A more complete discussion of the Internet and 
computer network theory is provided in the' following 
references hereby incorporated by reference: 

1. D. Comer, The Internet (1995). 

2. D. Comer, Computer Network s and Internets 
(1997). 

The method of linking to on-line resources with a 
scanner enhanced remote control unit is illustrated in Fig; 

6. The method comprises the steps of encoding address and 
access information to on-line resources, and optionally 
source identification information regarding the document the 
address information is embedded on into a format suitable to 
printing onto a document. The encoded information is 
embedded onto a document which is then scanned with the 
scanner enhanced remote control unit and optionally 
processed within the scanner enhanced remote control unit. 
The scanner enhanced remote control unit then transmits the 
scanned information with optional demographic information 
relating and the transmitted information is received. The 
received information is then optionally processed within the 
receiving system (typically a syst m adapted to access on- 
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line resources). User demographic information and the 
source identification information is optionally collected 
for subsequent analysis and the specific on-line resource 
corresponding to the address and access information encoded 
on the document is then retrieved and displayed to the user 

Potential applications for a direct and efficient 
link between printed media and on-line resources are 
potentially limitless. Broadcast schedules (e.g., TV 
Guide®) could be published with address and access 
information to on-line resources relevant to a particular 
program. Such schedules could then be scanned and used to 
link with the on-line resources. For instance; 


1 . sporting events could be listed with 
sites comprising player statistics, commercial sale of team 
related goods, books, video recordings of the event being 
watched, and advance ticket sales; 

2 . travel shows could be listed with sites 
providing further detail regarding the region being 

discussed, commercial sale of travel arrangements, maps, 
books, guides, suitable clothing, and luggage; 

3. educational shows could be listed with 
sites providing simultaneous access to on-line primary, high 
school, and college equivalency courses, tutoring in 
particular subjects, commercial purchase of books and 
compact discs, examinations taken on-line with instant 
results (each of which having particular applicability to 

the handicapped, temporarily injured, gifted or those with 
special needs; 
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4. prime time programs could be listed with 
sites providing schedules of guest appearances of actors and 
actresses, and the commercial purchase of books and tapes 
written by or about the program or players; 

5. telethons, and publicly supported 
channels could be listed with sites providing an option to 
simultaneously contribute via secure electronic currency; 

6. soap operas could be listed with sites 
providing access to prior episodes in summary or detail, 
background of characters and actors playing each character, 
and contact information regarding fan clubs; 

7. game shows could be listed with sites 
providing simultaneous participation in on-line versions of 
the same game being conducted via broadcast or cable 
transmission; 


8. nature shows could be listed with sites 
providing an option to simultaneously contribute to 
wildlife/restoration funds using secure electronic currency, 
and information regarding conservation of and travel to the 
regions being filmed; 

9. movies cold be listed with sites 
providing the ability to purchase relevant books and videos 
, participate in trivia quizzes, and information regarding 
special appearances of actors, and fan clubs; and 
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10 . 


talk shows could be listed with sites 


providing the ability to reply and participate in 
discussions with the audience. 


While various changes and modifications may be 

made in the detailed construction, it is understood that 

such changes or modifications will be within the spirit and 

scope of the present invention, as it is defined by the 
appended claims. 
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CLAIMS: 


1. A method of providing remote access to on-line 
resources comprising the steps of: 

encoding address information adapted to link 
to an on-line resource into a format adapted for printing on 
a document; 

embedding said encoded information onto said 

document; 


scanning said document with a scanner 
enhanced remote control unit comprising a scanning system 
adapted to obtain an image of said embedded information and 
a transmission system.adapted to transmit information to a 
system adapted to access said on-line resource; 

transmitting said scanned information; 
receiving said transmitted information by 
said system adapted to access said on-line resource; 

retrieving said on-line resource 
corresponding to said address information; and 


displaying said on-line resource to a user. 


2. The method of claim 1, further comprising 
processing said scanned image in said scanner enhanced 
remote control unit prior to said step of transmitting. 

3. The method of claim 1, further comprising 
processing said received information in said system adapted 
to link to said on-line resource subsequent to said step of 
transmitting. 


4. The method of claim l, wherein said format 
further comprises linear, one-dimensional bar code. 
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5. The method of claim 4, wherein said scanning 
system further comprises a one-dimensional laser scanner. 

6 . The method of claim 4, wherein said scanning 
system further comprises a two-dimensional laser scanner. 

7. The method of claim 4, wherein said scanning 
system further comprises an LED wand scanner. 

8 . The method of claim 4, wherein said scanning 

system further comprises a linear, one-dimensional array of 
charge coupled devices. 

9. The method of claim 4, wherein said scanning 

system further comprises a two-dimensional array of charge 

coupled devices. 

10 . The method of claim l, wherein said format 
further comprises two-dimensional bar code. 

11. The method of claim 10, wherein said scanning 
system further comprises a two-dimensional laser scanner. 

12. The method of claim 10, wherein said scanning 
system further comprises a linear, one-dimensional array of 
charge coupled devices. 

13. The method of claim 10, wherein said scanning 
system further comprises a two-dimensional array of charge 
coupled devices. 
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14. The method of claim 1, wherein said format 
further comprises printed matter, said scanning system 
comprising a two-dimensional array of charge coupled 
devices, said step of scanning being performed by optical 
character recognition techniques. 

15. The method of claim 1, wherein said system 
adapted to access said on-line resource further comprises a 
web-ready television. 

16. The method of claim 1, wherein said system 
adapted to access said on-line resource further.comprises a 
television set-top conversion unit adapted to allow an 
associated television to display Internet resources. 

17. The method of claim 1, wherein said system 
adapted to access said on-line resource further comprises a 
personal computer 

18. The method of claim 1, further comprising 
encoding identification information regarding said document 
into said format, embedding said information regarding said 
document onto said document, and transmitting said 
information regarding said document with demographic 
information regarding said user. 

19. The method of claim 7, further comprising 
receiving said identification information regarding said 
document and said demographic information, thereby enabling 
an on-line provider and an on-line server to gain access to 
said demographic information and said identification 
information. 



wo 98/51036 


PCT/US98/09413 


20. The method of claim 1 , wherein said step of 
scanning said document further comprises scanning 

automatically in response to said scanner enhanced remote 
control unit being passed across said document. 


W A. 


me method of claim 1 , wherein said step 
scanning said document further comprises scanning in 

response to depression of a scan button on said scanner 
enhanced remote control unit while said scanner enhanced 
remote control unit is passed over said document. 


Vi. 


22. The method of claim 1 , 
transmitting said scanned information 
transmitting said scanned information 
subsequent to scanning. 


wherein said step of 
further comprises 
automatically 




The method of claim l, wherein said step of 


transmitting said scanned information further comprises 
transmitting said scanned information in response to 

depression of a transmit button on said scanner enhanced 
remote control unit. 




mecnoa of claim l, wherein said 


—, bdia 

transmitted information represents substantially all of th 
portion of said document scanned. 


25- The method of claim 1 , wherein said 
transmitted information represents less than substantially 
of that portion of said document scanned. 
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26. The method of claim 1, wherein said scanning 
system and said transmission system share light sources. 

27. An apparatus for providing remote access to 
on-line resources comprising, which comprises: 

means for encoding address and access 
information adapted to link to said on-line resource into a 
format adapted for printing on a document; 

means for embedding said encoded information 
onto said document; 

a scanner enhanced remote control unit 
comprising a means for scanning adapted to scan and obtain 
an image of said embedded information and means for 
transmitting adapted to transmit information to a system 
adapted to access said on-line resource; 

means for receiving said transmitted 
information by said system adapted to access said on-line 
resource; 

means for retrieving said on-line resource 
corresponding to said address and access information; and 

means for displaying said on-line resource to 


28. The apparatus of claim 27, further comprising 
means for processing said scanned image in said scanner 
enhanced remote control unit prior to application of said 
means for transmitting. 

29. The apparatus of claim 27, further comprising 
means for processing said received information in said 
system adapted to link to said on-line resource subsequent 
to application of said means for transmitting. 
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30. The apparatus of claim 27, wherein said 
format further comprises linear, one-dimensional bar code 

31. The apparatus of claim 30, wherein said 

scanning system further comprises a one-dimensional laser 
scanner. 


32. The apparatus of claim 30, wherein said 

scanning system further comprises a two-dimensional laser 
scanner. 


33. The apparatus of claim 30, wherein said 
scanning system further comprises an LED wand scanner. 

34. The apparatus of claim 30, wherein said 

scanning system further comprises a linear, one -dimensional 
array of charge coupled devices. 


35. The apparatus of claim 30, wherein s 
scanning system further comprises a two-dimensional 
charge coupled devices. 


array of 


36. The apparatus of claim 27, wherein said 
format further comprises two-dimensional bar code. 

37. The apparatus of claim 36, wherein said 
scanning system further comprises a two-dimensional la. 
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38. The apparatus of claim 36, wherein said 
scanning system further comprises a linear, one-dimensional 
array of charge coupled devices. 

39. The apparatus of claim 36, wherein said 
scanning system further comprises a two-dimensional array of 
charge coupled devices. 

40. The apparatus of claim 27, wherein said 
format further comprises printed matter, said scanning 
system comprising a two-dimensional array of charge coupled 
devices, which scans by optical character recognition 
techniques. 

41. The apparatus of claim 27, wherein said 
system adapted to access said on-line resource further 
comprises a web-ready television. 

42. The apparatus of claim 27, wherein said 
system adapted to access said on-line resource further 
comprises a television set-top conversion unit. 

43. The apparatus of claim 27, wherein said 
system adapted to access said on-line resource further 
comprises a personal computer 

44. The apparatus of claim 27, further comprising 
means for encoding identification information regarding said 
document into said format, means for embedding said 
information regarding said document onto said document, and 
means for transmitting said information regarding said 
document with demographic information regarding said user. 
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45. The apparatus of claim 27, further comprising 
means for receiving said identification information 
regarding said document and said demographic information, 
thereby enabling an on-line provider and an on-line server 

to gain access to said demographic information and said 
identification information. 


46. The apparatus of claim 27, wherein said means 
for scanning said document automatically scans said document 
in response to said scanner enhanced remote control unit 
being passed across said document. 

47. The apparatus of claim 27, wherein said means 
for scanning said document scans in response to depression 
of a scan button on said scanner enhanced remote control 

unit while said scanner enhanced remote control unit is 
passed over said document. 


1 O 


™ e a PP a ratus of claim 27, wherein said means 


for transmitting said scanned information automatically 
transmits said scanned information subsequent to scanning. 


49. The apparatus of claim 27, wherein said means 
for transmitting said scanned information transmits said 

scanned information in response to depression of a transmit 
button on said scanner enhanced remote control unit. 

50. The apparatus of claim 27, wherein said 
transmitted information represents substantially all of that 
P or ^-^ on of said document scanned. 
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51. The apparatus of claim 27, wherein said 
transmitted information represents less than substantially 
all of that portion of said document scanned. 

52. The apparatus of claim 27, wherein said means 
for scanning and said means for transmitting share light 
sources. 


53. An apparatus comprising: 

a housing; 

optical scanning means within said housing for 
scanning a machine-readable symbol printed on a document and 
producing an electrical signal indicative of said machine- 
readable signal, said machine-readable symbol being encoded 
with data representative of a location of a data file to be 
accessed by a computer means associated with said apparatus; 

means within said housing for processing said 
electrical signal to produce address information useful in 
accessing said data file; 

means within said housing for transmitting said 
address information to a remotely located computer means; 
and 

means within said housing for remotely controlling 
a television means associated with said computer means. 




FIG. 1C 
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FIG. 2B 
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